Europaisches 
Patentamt 


European 
Patent Office 


Office europeen 
des brevets 


REC'D 0 7 MAR 2005 


WIPO 


PCT 


Bescheinigung Certificate 


Attestation 


Die angehefteten Unterla- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nach- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung Oberein. 


The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 


Les documents fixes a 
cette attestation sent 
conformes a la version 
initialement d^posee de 
la demande de brevet 
europeen specifiee d la 
page suivante. 


Patentanmeldung Nr. 


Patent application No. Demande de brevet n' 

04101008.3 


PRIORITY 
DOCUMENT 


per President des Europaischen Patentamts: 
Im Auftrag 

For the President of the European Patent Office 
Le President de roffice europeen des brevets 

P.O. 


R C van Dijk 


EPA/EPO/OEB Form 1014.1 - 02.2000 7001014 



Europaisches 
Patentamt 


European 
Patent Office 


Office europeen 
des brevets 


Anmeldung Nr: 
Application no. 
Demande no: 


04101008.3 


Anmeldetag: 
Date of filing: 
Date de d^pot: 


11.03.04 


Anmel der/Appl lean tC s)/DGmandeur( s) : 

Koninklijke Philips Electronics N-V. 
Groenewoudseweg 1 
5621 BA Eindhoven 
PAYS-BAS 


Bezelchnung der Erf 1„dung/Tl tie of the Inventlon/Tl tre de T Invention- 

If no Vtl' h'""^''' '^''"'""^ "^"^'^ ""^^^^^'^^ Besch;e1bung. 

If no title IS shown please refer to the description 

SI aucun titre n'est 1nd1qu4 se referer a la description.) 
A method and system for processing sound signals 

JevCn"d?;u^^^^ PMorlHt(en) / Priori tyCles) claimed /Prlorlt.(s) 

Staat/Tag/Aktenze1chen/State/Date/F11e no./Pays/Date/Num^ro de d^pot: 


iT^.TrV^'T.'" ''^^^"^^^^^^^^^'^-^^^"/Internatlonal Patent Classification/ 
Classification Internationale des brevets: 

H04S7/00 


" ?? RO S™ s"k S " ™ " » 


04101008. 3 

EPA/EPO/OEB Form 1014.2 - 01.2000 7001014 


2 



10 


15 


20 


25 


PHNL040271EPP 

^ 11.03.2004 
A method and system for processing sound signals 


This invention relates to a method and system for processing somid signals for 
a surromid left channel and a surround right channel, to a delay management unif, to an 
acoustic system such as a home entertainment device, an automotive sound system ete. to a 
mixing unit for such an acoustic system and to a sound system. 

A number of sound signal processing techniques have been developed in 
attempts to improve the quaUty of sound reproduced using loudspeakers in an acoustic 
system, particularly for acoustic systems comprising stereo sound channels, which consist of 
left and right channel components. Examples of such acoustic systems are home acoustic 
systems such as hi-fi systems, cinema sound systems, and automobile sound systems, which 
aU process sound channels to give sound input signals for loudspeaker. A "loudspeaker" is 
generaUy understood to be the physical device or "driver" ^ch converts sound input signals 
into audible sound waves. i.e. a membrane which is caused to vibrate by an electromagnet, 
which is in turn activated by the sound signals. When monopole loudspeakers are used, the 
sound ^ears to originate from the direction of the loudspeakers. A dipole loudspeak^ or 
driver comprises two sources of sound with opposite phase, separated by a small distance. A 
dipole loudspeaker does not radiate equaUy in aU directions, so that its directivity pattern 
features two lobes indicating strong sound radiation, and other directions in which no sound 
is radiated. This can be realized by a loudspeaker consisting of a number of drivers grouped 
together. One or more loudspeakers can be housed in a "box". Jn the following, the term 
•loudspeaker" can refer to a single driver or a gicoap of drivers, sometimes called an "array". 

Stereo sound signals are converted to sound by loudspeakers usually situated 
to the left and right of a listener, so that the sound is directed more or less towards the left 
and right ears of the speaks. 

Some acoustic systems attempt to deUver a better Ustening experience by 
issuing sound from an arrangement of speakers positioned at various locations around the 
room, e.g. Dolby Digital 2.0 or Dolby Digital 5.1, where up to six loudspeakers can be 
implemented - a subwoofer for bass signals, two front loudspeakers, two surround 
loudspeakers, and a center loudspeaker. A disadvantage of these systems is that the additional 
loudspeakers required must be positioned at a distance behind the Ustener. This is not always 
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possible, particularly for home entertainment systems for smaU rooms where the Ustener is 
mable to place his seating arrangemait in ttie middle of room to aUow for the necessary 
separation io the rear loudspeakers. Furthermore, such loudspeakers must he comiected in 
some way to the ampUfier, which usuaUy means unsightly lengths of cable along the ceiling 
5 or floor. 

Other acoustic systems use dipole loudspeaker arrays to the fiont of the 
listener, producing different lobes for the center channel, left and right ftont channels, and 
left and right surround channels. The lobes of the surround channels are directed against the 
side walls, where the sound is reflected back towards the listener. Properties of the dipole 
10 loudspeaker can be used to good effect within a room to give diffiise and spacious sound 
reproduction. Sound reproduced in this way can give the Ustener the impression that he is 
surrounded by souad. This impression is strongest within a restricted area, known as the 
"sweet spot". Within tiie sweet spot, the listener is given the impression that the sound comes 
ftom all around, so that it does not appear to issue directiy from the loudspeakers. However, 
15 the quahty of the perceived sound decreases rapidly outside of the sweet spo t, and coloration 
or distortion is often perceived due to interference of the left and right surround channel 
components arising as a result of the constant discrepancy in distance traveled by the 
dififerent components of the stereo signals. 

Therefore, an object of the present invention is to provide enhanced surround 

20 sound perception in a broad listening area. 

To tiiis end, the present invention provides a method for processing sound 
signals for a surround left channel and a surround right channel, wherem a continually 
varying delay between flie signals of the surround right and surround left channels is 
generated. The delay, v^ickserves to decorrelate the surround left and right channels, might 

25 vary periodically, in which case it may oscillate on a very slow tim^scale such as several 
teas of seconds. EquaUy, it may have a random or pseudo-random nature. The decorrelation 
gives the e^ of enhanced surround sound perception, since the resulting "sweet spot" is no 
longerrestrictedtD a small area, but is spread overa larger area; The continual deconelation 
ofL mmound^signalaen^s tbattholistencr wilLnotbe suhjectedtD undeskable mono 

30 effects, which.can^se in othersystems-whereAe surroundsignals^ decorrelatsd. 
It isa cGDtEdiJointof the mvmtionAattheJ^and 
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Since delaying the left and right components of the stereo surround channel in 
this manner results in enhanced surround sound perception, the adjective "enhanced" can be 
used when referring to the surround channel or its left and right components in the following 
to avoid confosion with other types of delay in other sound signal processing steps. 

To achieve this enhanced surround sound perception by decorrelating the 
surround channels, a delay management unit might be used to provide a continually varying 
delay between the signals of the surround right channel and the surround left channel of a 
stereo surround channel. The continually varying delay might be generated by inserting 
variable delay units mto the signal paths of the left and right surround channels, and might 
oscillate periodicaUy, or might equaUy weU be of a random nature. The variable delay units 
and other elements of the delay management unit might be realized in the form of a circuit 
comprising mtegrated curcuits and/or analogue circuitoy. or might be realized using software 
comprising digital signal processing modules. Preferably, the delay management unit might 
be constructed using the most suitable combination of software modules and digital and/or 
15 analogue hardware elements. 

The dependent claims and the subsequent description disclose particularly 
advantageous embodiments and features of the invention. 

In a relatively simple embodiment of the invention, each surround signal is 
delayed in its entirety, i.e. over its entire fiequency range, wife respect to the oflier surround 
signaL Here, the entire left surround channel is delayed wittx respect to the entire right 
surround channel. 

To ensure that the varying delays introduced into the left and right surround 
channels are effectively different fiom each other at any time, the continually varying delay 
is preferably generated so that the left and right surround channels are at aU times 
decorrelatBd. This might be achieved by thoroughly computing the required delays and 
monitoring them to ensure that they are consistently dififerent. However, in a preferred cost- 
effective embodiment of the invention, the left surround chamxel and the right surround 
channel are each split into a number of frequency bands, and each frequency band of each 
surround channel is delayed with respect to other frequency bands of the same channel, and 
also witii respect to a corresponding frequency band of the other channel. By spUtting the 
channels int« component frequency bands in this way and delaying each frequency band by a 
different amount, an even better decorrelation is achieved. For example, each surround 
channel might be spHt mto low-, middle-, and high-frequency bands. The low-frequency 
band of one channel is then delayed against the middle-frequency band, and also against the 


20 


25 
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Mgh-ftequency band, so that the delay between each combinatiaa of two ftequency bands of 
tiiie same channel is difiEerent Fiirthermoie, since each frequency band is delayed by a 
different amount, the delays between each combination of frequency bands of Ihe left and 
right surround channels are also different. 

An appropriate delay management unit for generating enhanced left and right 
components for the surround channel of an sound processing system comprises a firequency 
spUtting arrangement for the left surround signal and for the right surround signal spUts each 
signal into a number of frequency bands and variable delay units in eadi surround channel 
and a control signal generator with control signal outputs connected to the variable delay 
units in such a way as to yield the continuaUy varying delay betweai left and right surround 
channels, so that each frequency band of each surround signal has its own variable delay unit, 
each of which is controUed by its own control signal itqjut. 

The control signals used for controlling the variable delay units are generated 
by a control signal generator, which might contain a dedicated signal source, realized in 
hardware or software, or might use an already existing signal present in the audio processing 
system. This signal might be periodic in nature, or might equally weU be a random or pseudo- 
random signal, and is used directly to control one of the variable delay units. In a cost- 
effective version, the control signal generator comprises only one signal source and a series 
of modification elements, used to derive the control signals for the remaining delay units by 
performing a series of modifications on the original control signal. The output of each 
modification element canbe used as a control signal input as well as the input t» the next 
nu)dification element, so that each control signal is different from all the rest. A modification 
might comprise increasing or decreasing the anq)Utude of a control signal, for example by 
doubling or by halving, or it might involve phase^sbifting the control signal to delay it for a 

specific amount of time. 

Since the originaLcontrol signal is altared in successive steps by the sequence 
of modification elements, eactof the resulting control signals differs fi»m the restin 
amplitude and phase. This ensures that eackvariable delay_umt has a unique control signal 
iiqjut Th6.amplitude-of.1he input control signal is interpreted aa^a value.of time, for ei^le, 
the higher th^anqjlitadE.of the conhoLsignal^tiieJongertiie dela^t-^Hedby tiia_varfable_ 
delay unitJoits aBSociatEdfi:squsm^bandJffius.e3ch cha^ 
a-c;tcla-imsL- kft3ndri,0it.=-_-is;dslsHedhLy a n fPirrmtr^ma uirLJurton^ 
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modified control signals is also always changing. As a result, the firequency hands are 
continually delayed with respect to each other hy varying amounts. 

A delay management unit according to the present invention can he 
incorporated in any sound processing system which is used to process sound signals, for 
example in an acoustic system such as a home entertainment system like a hi-fi system and/or 
TV system, in a studio system, or an automohile acoustic system. 

A studio system comprising such a sound processing system might for 
example be in a radio/TV or recording studio environment, where signals for various sound 
channels are mixed for radio/TV program or cinema soundtracks. The studio sjrstem might 
also he used to store a soundtrack incorporating enhanced surround sound channels - for 
example a movie soundtrack or simply music - on a memory medium, together with any 
accornpanying tracks such as video, for later use. Such a memory medium might be a 
compact disc (CD), digital video disc (DVD), video cassette, memory stick, hard-disk etc. 
The soundtrack might also be stored in a means suitable for downloading fix)m the intemet, 
for example, for movies on a pay-per-view basis, or for music soundtracks for an online 
music downloading service. 

The surround sound signals can be processed in a delay management unit of 
the sound processing system according to the present invention before mixing with the other 
sound channels to incorporate enhanced surround sound in the soundtrack. In this way, a 
listener does not necessarily have to have an acoustic system with a sound processing system 
at home containing such a delay management unit in order to enjoy enhanced surround sound 
perception. Even if such a soundtrack, produced using decorrelated surround signals, is 
played fi-om CD, DVD etc. and input to an sound processing system which also comprises a 
delay management unit according to the present invention, the surround signals are 
eflFectively subjected to a second decorrelation, which does not have any adverse effects on 
the quality of the reproduced sound. 

A preferred acoustic system for producing enhanced surround sound, for 
example, in a home environment, comprises a source of a number of distinct input sound 
channels, an sound processing system according to the invention for processing the sound 
channels and a number of loudspeakers for converting the processed sound channels into 
audible soxmd. The sound channel inputs for such an acoustic system might comprise a mono 
channel, a bass channel, a stereo front channel, and a stereo surround channel, where the 
stereo channels comprise left and right signals. The signals might be processed and mixed in 
the sound processing system in such a way as to give sound signals to drive the loudspeakers. 
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The loudspeakers of the acoustic system can be distributed over a number of 
boxes, each containing loudspeaker arrays. For example, in a typical constellation, a single 
subwoofer loudspeaker containing a single driver is used for reproducing bass sound, 
whereas a left and a right box, each of which might contain a number of loudspeaker drivers 
5 (loudspeaker arrays), are used to reproduce sound comprising left and right components of 
the stereo channels, respectively. In such an arrangement, some mixing of the channel 
components of the different channels is carried out in order to attain any desired dipole 
directivity for the loudspeaker arrays. To achieve this, the enhanced surround channel is 
mixed with other sound channels, e.g. the center channel and the left and right front channels, 

10 and forwarded in such a way to a number of loudspeakers, so that conversion to audible 

sound waves results in dipole loudspeaker lobes with the desired directional arrangement. For 
example, an input sound signal for a loudspeaker array on the right-hand side might be 
obtained by mixing the right channel component of the front stereo channel in a particular 
manner with the center channel and the enhanced right channel component of the surround 

15 stereo channel. Similarly, a sound signal for a loudspeaker array on the left-hand side might 
be obtained by mixing the left channel component of the front stereo channel in a particular 
manner with the center channel and the enhanced left channel component of the surround 
channel. The signals mixed in this way contain components of more than one stereo channel, 
so that the loudspeaker arrays driven by these signals exhibit the desired dipole behavior, 

20 with a number of different lobes for the center channel, rigjit and left front channel, and right 
and left surround channels. 

To this end, the sound processing system of the acoustic system coniprises a 
mixing unit for mixiag the input sound channels to give soimd output channels, and 
forwarding the imxed and umruxed (bass) sound channels to the loudspeakers in such a way 

25 as to yield the desired directional arrangement of dipole loudspeaker, lobes. 

Such a miVing unit might take the form of a signal unit or entity suitable for 
insertion into an existing sound system. The mixing unit might comprise line inputs for the 
sound ctennels and line outputsifor connection to loudspeakers, as well as a means for 
mixing.the sound-channels to give_ sound outputch^mels in such a way aB to yield a 

30 directronaLairangementof dipole loudspsakes: lobes. 

lira partiGulsijdLy prsfermd embodiment, the B3irdng:unit comprises user^ 
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information relating to the relative positions of the loudspeakers and the user, by entering the 
relevant data by means of a suitable user interface. This information might tben be converted 
into an appropriate form, such as suitable values for delay and scale elements in the delay 
arrangement, to result in the desired directivity of the loudspeaker lobes. 

The delay management unit according to the present invention for the 
purposes of enhancing the perception of surround sound by introducing a continually varying 
delay between the surround right and surround left signals, might be incorporated in this 
mixing unit, or might precede the mixing unit as a stand-alone unit 

A sound processing system according to the present invention or an acoustic 
system comprising such a sound processing system might perform some of the sound signal 
processing steps described above by implementing software modules or computer program 
products. Such a computer program product mi^t be directly loadable into the memory of a 
programmable sound processing system, such as might be found in a home hi-fi system, PC, 
or a recording studio sound systenai, etc. Some of the units or modules for processing the 
sound chajmels and introducing a variable delay into the surround signals can thereby be 
realized in the form of computer program modules. Since any required software or algorithms 
might be encoded on a processor of a hardware device, an existing sound processing system 
might easily be adapted to benefit from the features of the invention. Altematively, the 
components for processing sound channels in the manner described can equally be realized 
using hardware modules. 

Other objects and features of the present invention will become apparent from 
the following detailed descriptions considered in conjunction with the accompanying 
drawing. It is to be understood, however, that the drawings are designed solely for the 
purposes of illustration and not as a definition of the limits of the invention. 

Fig. 1 is a schematic diagram showing a loudspeaker arrangement with 
associated dipole lobes and path of reflection of the surround sound off the surrounding walls 
towards the listener's position; 

Fig. 2 is a schematic diagram of an acoustic system in accordance with an 
embodiment of the present invention; 

Fig. 3 is a block diagram of a bass redirection module; 

Fig. 4 is a block diagram of an energy rebalance module; 

Fig. 5 is a block diagram of a ftont/rear cross-over and equalization; 
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Fig. 6 is a block diagram of a center cross-over and equalization; 
Fig. 7 is a block diagram of a mixing unit in accordance with an embodiment 
of the present invention; 

Fig. 8 is a schematic diagram showing a loudspeaker array with various 
5 listening positions in accordance with an embodiment of the present invention; 

Fig. 9a is a block diagram of a delay management unit in accordance with a 
first embodiment of the present invention; 

Fig. 9b is a block diagram showing a delay management unit in accordance 
with a second embodiment of the present invention; 
10 Fig. 9c is a block diagram showing a delay management unit in accordance 

witii a third embodiment of the present invention; 

Fig. 10 shows graphs of control signals for the delay units in a delay 
management unit according to Fig. 9b; 

Fig. 1 la. Fig. 1 lb. Fig. 11c, Fig. lid and Fig. 1 le are schematic diagrams 
15 showing loudspeaker arrangements in accordance with embodiments of the present invention; 
Fig. 12 is a block diagram of a studio sound system. 


Throughout the description of the figures, a lower-case reference character "L" 
20 denotes the lefl: component of a stereo sound channel, and a lower-case reference character 
"R" denotes the right component. Like numbers throughout the figures refer to like 
components. 

Fig. 1 shows a loudspeaker arrangement fiom above, where the arrangement 
comprises loudspeaker boxes 20, 21 containing loudspeakers LI, L2, L3, Rl, R2, R3. For the 

25 purposes of illustration, dipole lobes DLi, DL2, DL 3, DL 4, DL 5, DL 5 of the loudspeaker 
arrays are also drawn in the figure. By applying appropriate mixing techniques, the dipole 
lobes DLi, DL2, DL 3, DL4, DLs, DLe of the speakers LI, L2,_L3, Rl, R2, R3 caabe 
directed tow^ds or away firom-the listener 13 to influence the quaUty of sound perception. 
Here, the center dipole lobes DI^, DL 4 andAontstereo dipoleJobes DL 2, DL_5 ara_directed 

30 towards theJistener 13. Ilia rear suira Dl4^DL.6 LI, RS, on 1iie_otheirhasKi^e_ 

directed aws^r&wl1ihBJiE^^^l^^::13 andJDix^rdsAa.suroOTndM^^ 14i>^ 14^ of ths_ 
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reflection generate a diffuse sound efifect, giving an impression of sound coming ftom aU 
around. 

Fig. 2 shows an acoustic system 3 for stereo sound reproduction as might be 
found in a hi-fi system for home use, in an automobile, in a cinema, etc. Input signals of 
different sound channels F, S, C, B which might originate from an external source such as 
cable or satellite, or from an internal source such as a tuner, VCR, DVD, CD-ROM, movie 
sound-track etc., are processed by an sound processing system 2 to give modified output 
sound channels Aj, A2, A3, A4 which are amplified by amplifiers 15, 16, 17, 18 before being 
converted to audible sound in a loudspeaker arrangement 20, 21, 22. The input sound 
channels typicaUy comprise stereo channels F, S, a center mono channel C and a bass 
channel B. The stereo channels are front F and rear surround S channels which in turn 
comprise left Fl, Sl and right Fr, Sr components. 

In Fig. 2, various distinct processing stages 8, 9, 10, 1 1, 4 are shown. 
Fig. 3 shows a first stage 8 for cross-over and bass management, where some 
processing is performed on the signals of the input channels F, B, C and B to obtain an 
optimal low-fi«quency or bass signal A4, for input to the amplifier 18 assigned to the 
subwoofer 22, for which the low frequencies are boosted as desired while ensuring that an 
overloading of the amplifier 1 8 wiU not arise. Firsf^ the input signals of aU channels Fl, Fr, 
Sr, Sl, C and B arc scaled in blocks 801...806 to avoid clipping. Apart from the bass channel, 
all of the main channels are summed together in a summation block 810. The result of the 
summation is forwarded to a low-pass filter 811, the output of which is summed together 
with the scaled bass signal in a summation block 812. A following band-pass filter 813 is 
used to block frequencies below the tuning firequency of the subwoofer 22. Bass signals are 
fijTfher enhanced by a bass automatic level controller (ALC) 814, the parameters of which are 
chosen to suit the subwoofer 22 being used. The output A4 of the bass ALC requires no 
fiarther processing before amplification. The band-pass filter 813 and bass ALC 814 can be 
implemented in analogue circuitty. 

The next stage of the sound processing system 2 of Fig. 2 is an energy re- 
balance block 9, shown in detail in Fig. 4. The level of the surround channel S is boosted 
proportionaUy to the level of the front channel F in order to give the listener a maximum 
surround ejcperience. To this end, the left and right components Fl, Fr of the front channel F 
are scaled in a scaling block 900 and forwarded to a band-pass filter 901 . The mean of the 
resulting signal is calculated in a mean calculation block 903. Similarly, the left and right 
components Sl, Sr of the surround channel S are scaled in a scaling block 903 and forwarded 
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to a band-pass filter 904, after which the mean of the resulting signal is calculated in a mean 
calculation block 904. The output of flie mean calculation block 903 for the &aat channel F is 
divided by the output of block 904 for the surround channel S to give an energy quotient for 
the two channels. This is then passed first through a saturation filter 907 and then through a 

5 low-pass filter 908 to discard unwanted higher frequencies. The output of the low-pass filter 
is then used to scale the level of the input surround channel S to give a modified output signal 
of the surround channel S. The parameters for tiie processing stages in the energy re-balance 
block 9 are chosen carefully so that the resulting energy level of the output signal of the 
surround channel S never exceeds the energy level of the firont channel F. In this way, the 

10 mixing of the original sound signals is respected. 

Returning to Fig. 2, some further processing of the front F, surround S and 
center C channels is carried out in a cross-over and equalization blocks 10 and 1 1, which can 
be seen in more detail in Fig. 5 and Fig. 6 respectively. These blocks implement the 
equaUzation necessary due to the dipole characteristics of the loudspeakers. As shown in 

15 Fig. 5, the front channel F is passed though a high-pass filter 920 and two bi-quad filters 921, 
922 before scaling in a scaling block 923 and subsequent filtering by a shelving filter 924 to 
give a modified output signal of the front channel F. Similarly, the rear surround channel S is 
filtered in a high-pass filter 930 and a subsequent bi-quad filter 93 1 before being amplified 
by a gain block 932 to give a modified output signal of the surround channel S. Similar 

20 processing is carried out for the center channel C m the cross-over and equalization block 1 1 , 
where the input center channel C is first passed to a high-pass filter 940 before being scaled 
in a scaling block 941 and subsequently filtered m a shelving filter 942 to give a modified 
output signal of the center channel C. Some of the filter blocks described in Fig. 5 and Fig. 6 
can be inqjlemented in analogue circuitiy, such as the higb-pass filters 920, 930, 940 and the 

25 scalmg fiOlters 924 and 942. 

The final stage of the sound processing system of Fig. 2 is a mixing unit 4, 
shown in detaiLmFig. 7. The purpose of the mising unit 4 is to mixfhe sound channelsF, §, 
C , arriving at line inputs 100, 200, 300, in a particulatmannerto give sound-ontpulrsignals 
Ai, Aa, As for the_amplifiers 15, 16, 17 to achieve 1h£Ldesired acoustic directivitsrat fhe_ 

30 loudspeaksiairays. ThefiionLandsurronndjchaanElB F, S are scparatedinto theirleftand- 
right componentsLFL, Fr, Sl, Sr. ThaleftandjightconoponciitsrSL, Sr of fhe.surKsnndi 
ch-Hm£±3 arGifestijrQCSESGd in ajidayrmssEae mfflTt yvrnt i , vjh irh F^ i n mit ifr e cseatiolly tM-, 
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are processed along with the oflier sound channels Fl, Fr, Sl, Sr, C by a user-configurable 
delay arrangement 5. 

The user-configurable delay arrangement 5, which can be configured by the 
user by means of a user interfece 7, comprises a chain of processing units for each of the 
input signals of the different channels Fr, Fl, Sr, Sl, C. Each sound channel Fr, Fl, Sr, Sl, C 
is passed through a delay element 501, 502, 503, 504, 505, a scaling element 511, 512, 513, 
514, 515, and a filter 521, 522, 523, 524, 525. The delay elements 501, 502 and 505 are 
configured to compensate for fhe additional time required by the delay management unit 1 in 
processing the signals of the surround Sr, Sl. The parameters specified by the Ustener 13 to 
control the delay elements 501, 502, 503, 504 505 and scale elements 51 1, 512, 513, 514, 515 
influence the angle of directivity of the loudspeaker dipole lobes DLi, DLz, DL3, DL4, DL5, 
DLe. 

The outputs of the user-configurable delay arrangement 5 are mixed by 
summing and subtracting them together in a particular manner to give the required output 
channels Ai, A2, A3 leaving the mixing unit 4 at its line oulputs 101, 201, 301. To iUusttate, 
an output signal 584, derived fi-om the rear surround channel Sr, is combined with the signal 
of the firont right channel Fr in the summation element 53 1 . The result is inverted by the 
element 551 and subtracted fi^om a delayed signal 585 of the center channel C by the element 
532 to give a conoponent Ai. 2 of the output channel Ai for the anq)lifier 15 assigned to the 
surround loudspeakers LI, R3. The other component A,. , of the output channel Ai is 
obtained by adding the signal of the right surround diannel component !fe to a delayed signal 
of the fixmt right dhannel component Fr in the summation element 533. 

The output channel A2 for the an^lifi^ 1 6 assigned to the ftont loudspeakers 
L2, R2 is derived in a similar manner. The output channel A3 is derived by merely inverting 
the input C, since the signals for the loudspeakers L3. Rl, used to generate the dipole lobes 
DL3, DL 4 for the center loudspeakers, do not require any contributions fi-om othear sound 
channels. 

Fig. 8 shows anumber of position rows PI, P2, P3 fi:om which the listener can 
choose, hi this example, the loudspeakCTs 20, 21 are situated in front of the listener. The 
listener mi^ choose to be seated, for example, along position row P2. The choice of 
preferred position row might be governed by the dimensions of the room, or the listener 
might simply wish to be seated at P2 instead of, say, P3. To direct the loudspeaker dipole 
lobes towards the desired position row P2, the listener enters the necessary information 
concerning the loudspeaker 20, 2 1 placement and desired position row P2 by means of the 


PHNL040271EPP 


12 11.03.2004 
user interface 7. It is safficient to specify the distance d between the loudspeaker boxes 20, 
21 , and the distance given by the median m normal to the distance d. The corresponding 
parameters for the delay and scale elements of the user-configurable delay arrangement 5 are 
determined by the user intraface 7, which calculates the angle of placement Gj of the Ustener 

5 13, and the resulting angles of directivity for the d^ole loudspeaker lobes. Once the listener 
has specified his position in tins way, he can enjoy enhanced surround sound perception at 
any point along the row. Other Usteners located along the specified position row can also 
perceive tiie enhanced surround sound. 

The enhanced surround sound is generated by processing the signal of the rear 

10 surround channel S in a dedicated delay management unit 1 before mixing with the other 

sound channels in the mixing unit 4. This delay management unit 1 , which can be realized in 
a number of ways, is described in detail in Figs. 9a, 9b and 9c. The purpose of the delay 
management unit 1 is to decorrelate the left and right components Sr, Sl of the surround 
channel S as much as possible, by delaying them with respect to each other in a continually 

15 varying manner. 

Fig. 9a shows the simplest variation, where the signals of the left and right 
components Sl. Sr of the stereo surround channel S are delayed by separate delay elements 
Di, D2. A signal source G, which, together with the delay elements Di, D2 comprises the 
control signal generator 6, suppUes a control signal Ci. Here, the control signal Ci is in the 

20 form of a symmefaical ramp wave, since such a waveform is easy to generate. The signal 
generator might also generate any other praiodical signal, for example a sine or cosine 
waveform. The delay element Di interprets the amplitude of the control signal Ci as a delay 
value, and delays the signal of the component Sl by the propria!© length of time. The 
madraum ampUtude of ihe control signal Ci corresponds to a maximum delay - in this case 

25 3000 san^les - and the TniniTrmm amplitude corresponds to no delay at aU. 

The control signal Ci is modified by a modifier element Mi to give a second 
control signaLC2. The modification involves scaling and/or shifting Ihe conteol signal CI to 
give a contDol signal C2 ^chis essentially always different from Ci. The^lay:elementl>2 
inteqjretslheampEtude of tfaeLmodified-ControlsignalCi as avalue of timerand.delays-the 

30 signaLof the rightchanneLSR accordingly. 

SiacElhe_delays-ars_to aU HjiBntS-andqpuiproses abraysdiffiiCTitlhedeftand. 
rlshtsunmDiiaQteSL, Sf_ of tiba^t3iso[i;i3imd.ckm33eLS ssjEJfasrEbydsGQrrsistei Uss psriadof 
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originating from a static point. Wherever the listener is positioned, he will perceive, over a 
certain lapse of time, the same mean surrotind perception as a person located at another spot. 
Thus, the "sweet spot", at which listening experience is most enjoyable, is effectively spread 
over a larger area. This means that more than one listener can enjoy an optimal listening 
experience. 

By decorrelating individual frequency bands of the left and right stereo sound 
channel components Sl, Sr, an even better listening experience can be given. Fig. 9b shows a 
delay management unit 1 in which each surround signal component Sl, Sr is put through a 
high-pass and a low-pass filter Fi, F2, Pi, F'2 thereby splitting each signal component Sl, Sr 
into corresponding frequency bands Bj, B2, B'l, B'2. Each frequency band Bi, B2, B'l, B'2 is 
delayed by an amount determined by a corresponding delay element Di, D2, D'l, D'2. A gam, a 
signal generator G is used to supply a control signal Ci in the form of a ramp wave. Again, 
the maximum ampUtude of the control signal Ci corresponds to a maximum delay - in this 
case 1500 samples - while an amplitude of 0 corresponds to a delay of 0 sainples. The 
control signal passes through a series of modifiers Mi, M2, M3, giving a separate control 
signal Ci, C2, C'l, C'2 for each of the delay elements. 

The extent to which the control signal is modified is shown in Fig. 10, which 
shows the outputs Ci, C2, C'l, O2 of the signal generator G and the modifier elements Mj, M2, 
M3. The output of the signal source G is a symmetrical ramp wave Ci with a period of 50s 
and an amplitude xi inteipreted by Di to give a maximum delay of 1500 samples. Modifier 
element Mi modifies control signal Ci by doubling it to give control signal C2, whose 
amplitude T2 is interpreted by delay element D2 to give a corresponding maximum delay of 
3000 samples. Modifier element M2 in turn modifies control signal C2 by introducing a 
phase-shift to give control signal C'2- The amplitude x'2 of control signal C'2 is interpreted by 
delay element D'2 to give the corresponding delay value. A final modifier M3 halves the 
amplitude of control signal C'2 to give control signal C'l, whose amplitude x'l is interpreted 
by delay element D'l. Thus, four different values of delay Xi, X2 , x'l, x'2 are used by the delay 
elements Di, D2, D'l, D'2 to introduce delays in the frequency bands Bi, B2, B'l, B'2, which 
are recombined to give decorrelated stereo signals of the surroimd channels Sl, Sr. This 
example demonstrates a relatively easy and cost-effective way of decorrelating surround 
channels Sl, Sr by using a signal source G to supply a simple waveform Ci and modifying 
this in an uncompUcated way to yield a number of different control signals C2, C'l, C'2. 

The decorrelation can be performed even more thoroughly by splitting the 
surround channels Sl, Sr into a greater number of frequency bands and applying a 


PHNL040271EPP 


14 11.03.2004 
correspondingly greater number of control signal modifiers and delay elements. An example 
of such a delay management iinit is shown in Fig. Pc, where each surround channel Sl, Sr is 
split into n jfrequency hands by means of appropriate hand-pass filters Bi, B2, . Bn, B'l, B'2, 
. . B'n to give frequency hands Fi, F2, . . Fn, Pi, F'2, . . F'n- As in the previous examples, 
5 each frequency hand is delayed hy a dedicated delay element Di, D2, . . Dn, D'l, D'2, . . D n 
controlled hy the corresponding control signal Ci, C2, Cn, C*i, C2, CV The signal 
generator G supplies the control signal Ci from which the remaining control signals are 
derived hy the modifiers Mi, M2, . . Mn. The delayed frequency bands are recomhined to 
give the decorrelated output signals for the surround channels Sl, Sr. Since this is a 
10 considerably more complicated example, such a realization is more suited to particularly 
high-end devices. 

A number of possible loudspeaker arrangements for a Ustening position are 
shown in Fig. 11a, lib, 11c, lldand lie. 

In Fig. 1 la, loudspeaker hoxes 20, 21 are positioned in front of the listener 13, 

15 and to his left and right. The sound reproduced by the loudspeakers in the boxes 20, 21 

originate in this example from a home entertainment device 26 such as a television or hi-fi 
system. The acoustic system which supplies the sound signals for the loudspeakers in the 
hoxes 20, 21 might he incorporated in the home entertainment device 26, or may he located 
elsewhere. The signals are mixed in the acoustic system to give dipole directivity for the 

20 loudspeaker drivers, so that front and center chaunels are directed towards the Ustener 13, 
while the surround channel is directed towards the walls 14a, 14b to the left and right of the 
listener. The sound waves produced by the speakers in the boxes 20, 21 are then reflected off 
the side walls 14a, 14b in such a manner as to travel towards the wall 14© behind the listener 
13, where they are reflected once more so that they now travel to wards the listener 13. 

25 In Fig. 1 lb, the loudspeakers boxes 20, 21 are this time positioned to theJeft 

and right of the listener 13 respectively. In thisexample, the homei entertainmentdevice 26 
incorporates a loudspeaker22, for example a subwooferfor the bass signals. The sound 
produced from the subwoofer 22_travels directiy towards the listener 13. The soundproduced 
by theJoudspeakers Jn thahoxes 20^ 2L_comprising frontanicenter chaanelsis directed 

30 towards fhew^ll 14^. in front of thahsteneir 13^ where the soundwaves are reflectediefore 
■(imjclmg hactto 'aiolistsnei:il3..Eimiiacly,-tha£Ound.^ the loud^^eskersiinihe 
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In Fig. 1 Ic, loudspeakers in two boxes 20, 21 direct sound towards the walls 
Ma, 14b to the left and right of the listener 13 . The drivers in box 20 direct the sound 
comprising front and center channels towards the walls 14a, 14b where it is reflected before 
traveling back towards the listener 13. In the same way, the drivers in box 21, used to convert 
the surround channel to sound and positioned behind the listener 13, also direct sound output 
towards the side walls 14a, 14b, where it is reflected before reaching the listener 13. 

A loudspeaker arrangement using only one box 23 is shown in Fig. lid. Here, 
all the loudspeakers required for converting center, front and surround channels to sound are 
housed in the same box 23. A center driver direct the bass sound output towards the listener 
13. The other drivers direct the front sound output towards the listener 13 from his lefl: and 
right, and direct the surround sound output tow^ds the side walls 14a, 14b, where the sound 
waves are reflected before reaching the listener 13. 

A last example is given in Fig. 1 le, showing an arrangement of 5 loudspeaker 
boxes 20, 21, 22, 26, 27 positioned all around the listeaier 13. Here, the loudspeaker in box 22 
directs the bass channel sound towards the listener 13. Drivers in boxes 20, 21 direct the front 
and center chaxmel sound towards the listener 13 from his left and right Two ftirfher boxes 
26, 27, positioned behind the listener 13, direct the rear or surround sound directly towards 
the listener 13 from behind. 

Surround sound, enhanced by a method according to the invention, can be 
produced for immediate listening in an acoustic system in a home environment, for surround 
sound signals originating fi»m a hi-fi or TV. Altematively, the enhanced surround sound 
signals can be produced for a sound-track or similar in a sound studio environment prior to 
conversion into a form suitable for storing on a memory storage medium. A considerable 
advantage of the invention is that, even if a listener does not avail of an acoustic system 
incorporating a delay management unit as described above, he can still enjoy the enhanced 
surround sound reproduced by his acoustic system using the sound signals played from the 
memory storage medium. 

Fig. 12 shows a sound processing system T for generating enhanced surround 
signals, in this case iu a sound studio. The sound input channels F, S, C and B, have been 
recorded in the usual manner to give to front, surround, center and bass sound channels. The 
recording might be, for example a movie soundtrack. The surround channel signals Sl, Sr are 
processed in a delay management unit 1 according to the invention to give sound output 
signals for the surround channels Sl, Sr which are recorded with the other channels F, C and 
B in a recording device 28. The recording, which can be in a format such as Dolby Digital 
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5. 1 , etc., can then be stored, generally in digital form, on a memory storage medium 29 such 
as CD-Rom, DVD, video tape, hard-disk, movie reel etc. The memory storage medium 29 
might be incorporated on a server to allow downloading of the recording from, for example, 
an internet shop. The recording can then be played on a home entertainment device, where 
5 the sound channels can be mixed to give the desired directivity. 

Alternatively, the enhanced sound signals might also be produced in a home 
acoustic system before converting to a form suitable for storing. The signals might then be 
written to a memory storage medium, for example by burning a DVD or writing to a video 
cassette tape. 

10 Although the present invention has been disclosed in the form of preferred 
embodiments and variations thereon, it will be understood that numerous additional 
modifications and variations could be made thereto without departing from the scope of the 
invention. The number of loudspeaker boxes and the number of drivers in each array depends 
to a large extent on the environment in which the acoustic system Jis used. In a home 

1 5 environment, for example, a relatively large number of loudspeakers might be used, whereas 
in an automobile, the loudspeakers are generally located in the doors or in the coclqpit, so the 
choice of loudspeaker in such ml acoustic system is generally limited by the relevant 
dimensions. 

For the sake of clarity, it is also to be understood that the use of "a" or "an" 
20 throughout this application does not exclude a plurality, and "comprising" does not exclude 
other steps or elements. A "unit" or "module" may comprise a number of blocks or devices, 
unless expUcitly described as a single entity. The term "hardware" can mean digital or 
analogue hardware, and might mean any type of circuitry such as boards, integrated circuits, 
oflE-the-shelf modules, custom modules etc. 
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CLAIMS: 


1. A m^od for processing sound signals for a surround left channel (Sl) and a 

surround right channel (Sr), wherein a continually varying delay between the resulting 
signals of the surround right (Sr) and surround left channels (Sl) is generated. 

^- A method according to claim 1, wherein the continually varying delay is 

generated so that the signals of the left and right surround channels (Sl, Sr) are decorrelated 
at all times. 


^- A method according to claim 1 or 2, wherein the left surround channel (Sl) 

and the right surround channel (Sr) are each split into a number of frequency bands (Bi, B: 
...,Bn,B'i,B'2, By, and each fi-equency band (Bi,B2, B„,B'i,B'2, B'„) of each 
surround chmmel (Sr, Sl) is delayed with respect to other frequency bands (Bi, B2, . . ., B 
B'l, B'2, B'„) of the same channel (Sr, Sl), and also with respect to a corresponding 
frequency band (B'l, B'2, B'^ Bj, B2, .... B^ of the other chaonel (Sl, Sr). 


'2, 


^- A method according to any of claims 1 to 3, wherein the surround left channel 

(Sl) and the surround right channel (Sr) are mixed with other sound channels (Fr, Fl, C) and 
forwarded to a number of loudspeakers (LI, L2, L3, Rl, R2, R3) in such a way as to yield 
sound output signals (Aj, A2, A3, A4) with a directional arrangement of dipole loudspeaker 
lobes (DLi, DL 2, DL 3, DL 4, DL 5, DL «). 

^- A method according to any of claims 1 to 3, wherein the delayed surround 

channels (Sl, Sr) are stored together with associated sound (Fr, Fl, C, B) and/or video 
channels in a storage media for later use. 

6. A delay management unit (1) for a surround right channel (Sr) and a surround 

left channel (Sl) of a stereo surround channel (S) with a number of variable delay units (Di, 

D2, ...,Dn,D'i,D'2, --jD'a) to provide a continually varying delay between the signals of the 
surround right channel (Sr) and the surround left channel (Sl). 
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7 A delay management unit (1) according to claim 6, comprising variable delay 

units (Di, D2, .. Dn, D'l, D'2 each surround channel (Sl, Sr) and a control signal 

generator (6) wilfa control signal outputs (Ci, C2, C„, C'l, C'2 Cy connected to the 

5 variable delay units (Di, D2, . . D,^ D'l, . . D'n) in such a as to yield the continually 
varying delay. 

8, A delay management unit (1 ) according to claims 6 or 7, comprising: 

a frequency splitting arrangement for the left surround channel (Sl) and for the 
10 right surround channel (SiO to split each channel into a number of frequency bands (81,62, 

...,Bn,B'i,B'2, ...,B'n); 

variable delay units (Di, D2, . . D„, D'l, D'2, . . D'n) for the different 
frequency bands (Bi, B2, . - Bn, B'l, B'2, . . B'„) in Ihe surround right channel (Sr) and the 
surround left channel (Sl ) and 


15 _ a control signal generator (6) for generating control signals (Ci, C2, . . ., Cn-i, 

Cj, C'2 C'n-i) to control the variable delays (Di, D2, Dn, D'l, D'2, D'„) m such a 

way as to delay each frequency band (Bi, B2, B„,B'i,B'2, B'n) of each surround 
channel (Sl, Sr) with a continuaUy varying delay with respect to other frequency bands (Bi, 
B2, Bn, B'l, B'2, ...» B'n) of the same channel (Sl, Sr), and with respect to a corresponding 

20 frequency band (B',, B'2, . - ., B'n , Bi, B2, . . ., B„) of the other channel (Sr, Sl). 

9. A delay management unit (1) according to claim 7 or 8, where the control 
signal generator (6) comprises a signal source (G) and a signal modifier arrangement (Mi, 
M2, ...,Mn.i) which together provide control iiiputs (Ci,C2, ...,Cn-i, C'i,C'2, ...,C'n)forthe 

25 delayunits (Di,D2, ...,Dn,D'i,D'2, ...,D'n). 

10. A soundiprocessing system_(2, 2') comprising a delay management unit (1 ) 
according to any of claims 6 to 9. 

30 11^ An_acoustic_system_(3), said systemiconqsrisiag: 

a source of a nuiriher of distinct soundjchsasneis (P, S, B) including a 
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and a number of loudspeakers (LI , L2, L3, Rl , R2, R3) for converting the 
processed sound channels (Ai, Az, A3, A4) into audible sound; 

12. An acoustic system (3) according to claim 1 1 , where the number of 

5 loudspeakers (LI , L2, L3, Rl, R2, R3) are arranged to form an array and where the sound 
processing system (2) comprises a mixing unit (4) for mixing sound input channels (F, S, C) 
to give sound output channels (Ai, A2, A3, ), and forwarding sound output channels (Ai. A2, 
A3, A4) to the loudspeakers (LI, L2, L3, Rl, R2, R3) in such a way as to yield a directional 
arrangement of dipole loudspeaker lobes (DLj, DL2, DL3, DL4.DL5, DLe) for the sound 
10 input channels (F, S, C, B). 

13 . A mixing unit (4) for a sound processing system (2) with a number of distinct 
sound channels (F, S, C) includmg a surround left channel (Sl) and a surround right diannel 
(Sb) comprising; 

^5 - line inputs (100. 200, 300) for Ihe sound channels (F, S, C); 

line outputs (101, 201, 301) for connection to loudspeakers (LI, L2, L3, Rl, 

R2.R3); 

a means for mixing the sound channels (F, S, C) to give sound output channels 
(Ai, A2, A3) in such a way as to yield a directional arrangement of dipole loudspeaker lobes 
(DL 1 , DL 2, DL 3, DL 4, DL 5, DL e) and forwarding the sound ou^ut channels (Ai, A2, A3) to 
the line outputs (103, 203, 303); 

a delay management unit (1) according to any of claims 6 to 9 to generate a 
continuaUy varying delay between the surround ri^t and surround left channels (Sr, Sl). 

14. A mixing unit (4) according to claim 13, comprising a user-configurable delay 
arrangement (5) for delaying the signals of the diflferent sound channels (Fr, Fl, Sr, Sl, C) 
with respect to each other in such a way as to direct dipole loudspeaker lobes (DLi, DL2, 

DL4, DL 5, DL 6) for at least some of the sound channels (Fr, Fl, Sr, Sl, C) by choosing 
suitable delay scale values. 

15. A studio system comprising a sound processing system (2*) according to claim 
10. 
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16. A ccBtiqjutear program product directly loadable into the memory of a 
programmable sound processing system (2, 2') comprising software code portioos for 
performing the steps of a method according to claims 1 to 5 when said product is run on flie 
sound processing system (2, 2'). 

17. A memory medium storing a data ffle comprising sound and/or video channels 
including surround sound channels delayed using a melfaod according to any of claims 1 to 5. 
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ABSTRACT: 


The invention describes a method for processing sound signals for a surround 
left channel (Sl) and a surround right channel (Sb). Hiereby, a continually varying delay 
between the resulting signals of the surround right (Sr) and surround left channels (Sl) is 
generated. Furthermore the invention describes a delay management unit, a sound processing 
system, an acoustic system comprising such a sound processing sjratem, a mixing unit for 
such an acoustic i^?stem and a studio system comprising such a sound processing system. 
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